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Abstract — We consider the classical AWGN channel where the 
channel input is constrained to an amplitude constraint that 
stochastically varies at each channel use, independent of the mes- 
sage. This is an abstraction of an energy harvesting transmitter 
where the code symbol energy at each channel use is determined 
by an exogenous energy arrival process and there is no battery for 
energy storage. At each channel use, an independent realization 
of the amplitude constraint process is observed by the transmitter 
causally. This scenario is a state-dependent channel with perfect 
causal state information at the transmitter. We derive the capacity 
of this channel using Shannon's coding scheme with causal state 
information. We prove that the code symbols must be selected 
from a finite set in the capacity achieving scheme, as in the 
case of Smith. We numerically study the binary on-off energy 
arrivals where the amplitude constraint is either zero or a non- 
zero constant. 

I. Introduction 

We consider a communication scenario where transmission 
energy is not available at the transmitter before the commu- 
nication starts; instead, it arrives from an exogenous energy 
source during the course of communication as an indepen- 
dent and identically distributed (i.i.d.) process. Moreover, the 
transmitter does not have a battery to store the arriving energy. 
Hence, the code symbol energy in a channel use is constrained 
to the energy arrived in that channel use. We assume that the 
arrived energy can be observed by the transmitter causally, 
right before the code symbol is decided. Therefore, the code 
sequence is a function of the observed energy arrival and we 
find the capacity of this time-varying amplitude constrained 
system with causal state information at the transmitter. 

We consider the classical scalar AWGN channel model with 
the input-output relationship 

Y i = X i + N i , i = l,...,n (1) 

where Xi is the channel input, Ni is the i.i.d. Gaussian noise 
with zero-mean and unit-variance and Yi is the channel output 
at the ith channel use. Ei, . . . , E n is the i.i.d. energy arrival 
sequence where Ei 6 £ and |£| is finite. The system model is 
shown in Fig. Q] At each channel use, the transmitter observes 
Ei and generates a channel input Xi that satisfies X? < Ei, 
i.e., the code symbol is amplitude constrained to (the square 
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Fig. 1. The AWGN channel with time- varying amplitude constraints. 

root of) the observed energy. Therefore, the major effect of 
energy arrivals is the time variation in the amplitude constraint 
that the code symbol should obey at each channel use. As 
the transmitter can observe the energy arrival causally, the 
resulting system is a state-dependent channel with causal state 
information at the transmitter and no state information at the 
receiver. The state of the channel is the amount of energy 
available at each channel use. At each state, the channel 
conditioned on the realized state is an AWGN channel with 
an input amplitude constraint equal to the square root of the 
arrived energy. 

The channel capacity of the static amplitude constrained 
AWGN channel was first studied by Smith in (TJ. In 0], 
Smith proved that the capacity achieving input distribution 
has a finite support set and presented an algorithm for the 
calculation of that distribution. This line of research has 
later been extended in 12-0 for various channels includ- 
ing quadrature-amplitude constrained AWGN channel and 
Rayleigh and Ricean fading channels. In (6), the finiteness 
of the support set of the capacity achieving distribution for 
conditionally Gaussian channels with bounded inputs, which 
encompasses a large class of practical channels, is proved. In 
particular, optical channels and fading MIMO channels with 
and without state information at the receiver are encompassed 
in the finiteness result of [6|. Moreover, [7| reports finiteness 
of the capacity achieving distribution for the quantized output 
AWGN channel. Also in [8|, capacity achieving input distri- 
bution for a duty cycle constrained system is shown to have 
countably infinite mass points with finite number of points 
in each bounded interval. In (9), new sufficient conditions 



for the noise distribution are provided for the optimality of 
discrete channel inputs in an amplitude constrained additive 
noise channel. 

The capacity and optimal coding for a state-dependent 
channel with causal state information at the transmitter and 
no state information at the receiver was characterized by 
Shannon in IfTUl . In IflOl , Shannon proved that the capacity 
of the state-dependent channel with causal state information 
available at the transmitter only is equal to the capacity of an 
equivalent channel which has an input alphabet extended by 
the cardinality of the state alphabet. In the capacity achieving 
coding scheme, the codewords are matrices rather than vectors, 
whose number of columns is the block length and the number 
of rows is the cardinality of the state alphabet. At each channel 
use, the code symbol that corresponds to the observed state 
is put to the channel. In the sequel, we refer to this coding 
scheme as the Shannon strategy. 

The problem that we wish to address in this paper has two 
main characteristics: 

1) amplitude constraints due to available energy, and 

2) a state-dependent channel due to different energy arrivals 
where the state is naturally known to the transmitter but 
not to the receiver. 

In this paper, we find the capacity achieving scheme for the 
AWGN channel with time-varying amplitude constraints by 
applying and extending the results of Smith [ 1 1 and Shannon 
[ 10 1 . We obtain the capacity by applying the Shannon strategy 
to the time-varying amplitude constrained channel and opti- 
mizing the input distribution of the resulting extended alphabet 
channel. In particular, we extend the alphabet of the channel 
in accordance with the amplitude constraints and construct 
an equivalent channel which has the number of inputs equal 
to the cardinality of the alphabet of energy arrivals. Each 
input variable is constrained in amplitude by the square root 
of the corresponding amount of energy. We show that in the 
capacity achieving distribution each input has a finite support 
set, extending the result of Smith |T). 

Next, we numerically study the considered setting with a 
specific binary energy arrival process, which we refer to as 
on-off energy arrivals: at each channel use, either E amount of 
energy arrives or no energy arrives. We compare the capacity 
with several upper bounds such as the capacity of the AWGN 
channel with state information available at both sides and 
the capacity of the AWGN channel with an unlimited energy 
buffer (i.e, an infinite sized battery) ifTTI . ||l2l . The numerical 
results show that the capacity with an infinite sized battery is 
considerably higher than the capacity with no battery (i.e., the 
setting of this paper), indicating the usefulness of collecting 
energy. In [ 13 1, we extend the framework considered here from 
i.i.d. to general stationary and ergodic energy arrival processes, 
and to additive noise channels with the general family of noise 
distributions considered in |9]- 

II. Time-Varying Amplitude Constraints 

Before we address the time-varying amplitude constraints, 
we start with providing the necessary preliminary background 



on the AWGN channel with a static amplitude constraint. 

A. Static Amplitude Constrained AWGN Channel 

Discreteness of the capacity achieving input distribution for 
a static amplitude constrained AWGN channel was first shown 
by Smith in [ 1 1 and later the result was generalized for a wide 
class of noise distributions in [9|. The channel capacity under 
the amplitude constraint A is |fl] 

C Sm {A) = m^I F {X;Y) (2) 

where T is the space of input probability distribution functions 
whose support sets are constrained to [—A, A]. The subscript 
Sm refers to Smith. The proof of finiteness of the distribution 
is by contradiction and it requires systematic application of 
several steps ifTl, 1191: The first step is to prove that the space 
of distribution functions is compact and the objective function 
is concave in the weak topology. Next step is to obtain an 
optimality condition in terms of the support set. Smith, then, 
shows that the mutual information density function is analytic 
in a subset of C that includes BL Finally, he shows that 
the optimality condition, after using identity theorem from 
complex analysis, leads to a contradiction. 

B. Time-Varying Amplitude Constrained AWGN Channel 

We now consider the time-varying amplitude constrained 
channel shown in Fig. Q] Let A be the amplitude constraint 
random variable with the alphabet A = {ai, . . . , aw}. 
{Ak}kLi € A is the i.i.d. amplitude constraint process with 
probability that A k — ai is equal to pi for all k. The 
realizations of the amplitude constraints {Ai, . . . , A n } are 
observed by the transmitter causally and the code symbol must 
comply with the observed amplitude constraint at each channel 
use: 

\X k \<A k , k = l,...,n (3) 

The receiver has no information about the variations of 
the amplitude constraint at the transmitter. This is a state- 
dependent channel with causal state information available at 
the transmitter only 1 10]. The code sequence is determined as 
a function of the observed amplitude constraint sequence and 
the channel capacity is 

C S h=maxI(T;Y) (4) 

Pt(*) 

where T — [Ti , . . . , Tm] is an extended channel input related 
with the output as 

M 

PY\r(y\t) = ^2ptPN(y - U) (5) 

i=l 

where pn{ ) is the Gaussian density. In the subscript Sh 
refers to Shannon. 

C. Other Scenarios with Side Information 

We can cast the arriving energy as a state variable attached 
to the channel. Knowledge of the state affects the achievable 
rates. If neither the transmitter nor the receiver has perfect 



knowledge of {^4^}, coding should be performed according to with 
the minimum of the possible amplitude constraints otherwise 
some code symbol will violate amplitude constraint at some 
channel use. Hence, the best achievable rate in this case is 



C'n 



Csm (min en) 



where Cs m (minj a*) is Smith's capacity under the amplitude 
constraint mini o, ■ 

On the other extreme, if perfect information of amplitude 
constraints is available at both the transmitter and the receiver, 
a multiplexed coding strategy achieves the maximum possible 
rate. Consider \A\ parallel codes each generated with code 
rates Ri subject to the amplitude constraint a. L . Since the 
receiver can track the changes in the amplitude constraint 
perfectly and due to the inherent stationarity of the amplitude 
constraint process, multiplexing codes results in the following 
achievable rate: ^iPiRi — Ea[R(A)]. Maximizing over each 
amplitude constraint, we obtain the capacity in this case as 



a 



si@both 



\A\ 

E 

i=l 



PiCsm(ai) 



(7) 



where Csm{cn) is Smith's capacity under the amplitude con- 
straint Oj. 

III. Capacity with Causal Information at the 
Transmitter 

For simplicity, we will assume that the amplitude constraint 
process takes two different values, a\ and 0,2 with probabilities 
Pi and p2 = 1 — p\. However, the analysis is valid for any 
finite value of \A\. 

Before dealing with the capacity achieving input distri- 
bution, we describe the capacity achieving scheme iflOll . 
Codewords are matrices of n columns (block length) and 
of two rows (number of states). The columns are generated 
as n i.i.d. realizations of T = (Ti,T2) with the optimal 
cdf F*. Then, 2 nR such code matrices are generated as the 
codebook and they are announced to the receiver. During 
the message transmission, as the causal information of the 
amplitude constraint is observed, the transmitter puts the code 
symbol at the corresponding row to the channel. Decoding 
is performed using joint typicality, and as n — > oo, the 
probability of error tends to zero if R < C. 

We will now find the optimal cdf F* . We define the 
random variable T over T = [— 0i,Oi] x [—02,02] as 
T = [Ti,Ta] where T\ and T2 have support sets [—01,01] 
and [—02,02] with joint cumulative distribution function F. 
The space of joint probability distribution functions over 
[—01,01] x [—02,02] is: 



{pai pa 2 ~| 
F: / dF(*i,*a) = l[ 
J — at J—a 2 ) 



(8) 



The capacity of the AWGN channel with time-varying ampli- 
tude constraint and causal information at the transmitter is: 



(10) 



(6) where 



f(y\ti,h) = PiPn{v - h)+p 2 p N (y - t 2 ) (11) 

fiy-F) = f 1 f 2 f{y\ti,t 2 )dF{tx,t 2 ) (12) 
J —a\ J —a? 

Plugging in the AWGN expressions for the original channel, 
we will solve the following optimization problem: 
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f(y,F) 



dydF(t u t 2 ) (13) 



We will establish that the capacity achieving input distri- 
bution has a support set of finite cardinality. We will apply 
the steps of (TJ, Q for the proof, which are summarized in 
Section III- AI The main difference between the static ampli- 
tude constrained and the time-varying amplitude constrained 
problems resides in the fact that the channel between T and 
Y is not an additive channel. Hence f(y; F) is not obtained 
through a convolution integral and h(Y\T — (ti,t 2 )) is not a 
constant, it takes different values at different (ti,t 2 ). However, 
we will show that it is possible to obtain similar arguments for 
the line t\ = t 2 and this will lead us to the claimed extension. 
This way, we also extend the class of problems for which this 
technique is applicable. 

We note that Ip(T;Y) is a concave functional of F € O. 
Moreover, 51 is a convex and compact space in the weak topol- 
ogy. Finally, Ip(T:Y) is strictly concave and weakly differ- 
entiable in 51 with the mutual information density i(ti,t 2 ;F) 
such that the derivative at G € 51 is 



—I G (T;Y)=j J i(t x ,t 2 ;F)dG(t 1 ,t 2 )-I F (T; 
In particular, the mutual information density is 

, ff{y\h,t 2 ) 



Y) 
(14) 



i(h,t 2 ;F) 



f(y\h,t 2 )dy (15) 



Moreover, i(t\,t 2 ;F) in ( fT51 ) is continuous and has analytic 
extension over the two-dimensional complex numbers C 2 . 
These claims are parallel to those in (T), 0, (9). The proofs 
of these and all upcoming claims can be found in fT3l . The 
convexity and compactness of 51 as well as the concavity and 
weak differentiability of Ip(T;Y) guarantee the uniqueness 
of the solution of the optimization problem in ( fT3l . Next, we 
have the following Lagrangian theorem: 



C 



max/ F (r;F) 

Fen v ' 



(9) 



Theorem 1 Let F* e 51 and let Sf* indicate the support set 



of F*. Then, F* is optimal if and only if 

i(h,t 2 ;F*) < C, V(ti,t a ) G [-01, o x ] x [-03,03] (16) 
i(ti > t 2 ;J*) = C f , V(ti,t 2 )e5 F » (17) 

where C = I F * (T; Y). 

We now prove that Sf* is finite by contradiction. Assume 
Sf* includes infinitely many elements in R 2 . By using a 
sequence of steps analogous to those in flj. ||6l. Il9l. we obtain 
the following result: 

i{zi,z 2 ) = C, (zi,z 2 )€C 2 (18) 

where C = If* (T; Y) is the optimal value for the problem 
in ( fT3] l, i.e., the capacity. In particular, i(ti,t 2 ) = C for all 
(h,t 2 ) G M 2 . For ti=t 2 = t, we obtain Vt G M 

/CO 1 n ^ 

^e" * log (p(y; F)) dy = -C-- log(2^e) (19) 

([T9l causes a contradiction as in (TJ, (6|, Therefore, we 
have the following theorem. 

Theorem 2 <Sp* /s a finite set. 

A. Algorithm to Find Sf* 

We use a procedure similar to that in JTJ, (6) to find 
the finite support set of the capacity achieving distribution. 
We first fix the cardinality of Sp- The problem becomes a 
2(|<Sjf|) — 1 variable convex optimization problem with convex 
constraints. After solving this optimization problem, we get the 
distribution F that optimizes the objective function subject to 
the fixed cardinality. If F satisfies the necessary and sufficient 
conditions in Theorem QJ then F* = F. Otherwise, we 
increase the cardinality \Sp\ by one and repeat the procedure. 
We start with assuming that \Sp\ = 2. The optimal distribution 
subject to this cardinality constraint has two mass points at the 
edges (ti,t 2 ) = (01,03) and (h,t 2 ) = (-01,-02). If this 
input distribution does not satisfy the necessary and sufficient 
conditions in Theorem QJ we solve the problem subject to 
\Sp I = 3. We repeat the procedure until we reach a distribution 
that satisfies the conditions in Theorem [JJ 

IV. On-Off Energy Arrivals 

In this section, we consider on-off energy arrivals: At each 
channel use either E units of energy arrives or zero energy 
arrives. In this case, A = {01,02} where ai = and a 2 = 
VE > 0. We denote the probability that E units of energy is 
harvested with p on . We have 

C s i@both = PonC Sm{^/~E) (20) 

Note that C < C s m both and C no - si = 0. 

Sf* C K 2 is such that for all (ti,t 2 ) € Sf*, ti = 
since the amplitude constraint for T\ is ai = 0. Hence, the 
optimization problem is over the one dimensional cdf Ft 2 (t 2 ) 



only. The space of cdfs Tp 2 is such that 

rVB 

/ dF T2 (t 2 ) = l (21) 
J-Ve 

y 2 

For pn{u) — ~^^ e ~~ ' we have the capacity 

C= max I Ft AT 2 ;Y) (22) 

with 

•^• Y) - CL m ^ (m) dydFT - 

(23) 

where 

f(y\t 2 ) = (l - p on )pN(y) + PonPN(y - 1 2 ) (24) 

Note that similar to the static amplitude constrained AWGN 
channel [1], if \f~E~ is small, the support set of F} is 
symmetric binary with two mass points located at ±y/E. For 
Pon = 1, the problem reduces to Smith's amplitude constrained 
AWGN capacity problem. In this case, using the algorithm in 
Section IIII-AI we find that if \[E < 1.66, then symmetric 
binary distribution for T 2 is optimal and if \f~E~ > 1.66, 
optimal distribution of T 2 has more than two mass points. For 
Pon 7^ 1, the channel between T and Y is different from an 
AWGN channel; hence, the optimizing distribution is different. 
To capture this effect, we define a function of p on as follows 

U(pon) = max{a; G R : g(t 2 ,x) < g(x,x), V£ 2 G [-x,x]} 

where g(t 2 ,x) is the mutual information density i(x,t 2 ;F) 
evaluated at the binary symmetric distribution with two 
equiprobable mass points located at t 2 = —x and t 2 = x. 
Here, f(y\t 2 ) is given by d24"l >. In view of the conditions in 
Theorem [JJ U(p on ) is the highest amplitude constraint under 
which the binary symmetric distribution is optimum when the 
energy arrival probability is p on . 

The function U (p on ) is monotonically decreasing with p on 
as shown in Fig. [2] As p on is decreased, the number of 
channel uses the nature allows the transmitter to send a non- 
zero data symbol decreases and this leads to smaller capacity. 
We observe in Fig. [2] that as p on is increased, binary input 
distribution becomes optimal for a smaller range of amplitude 
constraints, leading U(p on ) to be monotonically decreasing. 

In Figs.[3]and|4] we compare the channel capacity under the 
on-off energy arrival when the state information is available 
at the transmitter causally with the capacity when the state 
(energy arrival) information is available at both sides. We also 
plot the channel capacity when the battery size is unlimited, 
i.e., E max — oo, as in ifTTl . fT2~l . The capacity in this case is 
| log (1 + p on E). In Fig. [3] we observe the differences in the 
capacities for different values of p on when \f~E~ = 1.5. The 
capacity achieving input distribution is binary for all p on in this 
case since \[E — 1.5 < 1.66. In Fig.@l we plot the capacities 
for different E for a fixed p on ■ Note that the capacity achieving 
input distribution changes as E is increased. We show the 
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Fig. 2. U(p on ) function for the AWGN channel with unit noise power. 
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Fig. 3. Capacity versus Pon for E = 2.25, i.e., VE = 1.5. 

ranges over which the capacity achieving input distribution 
is binary, ternary and quaternary in Fig. |4] In particular, 
the capacity achieving distribution for d20l ) is the capacity 
achieving distribution with a constant amplitude constraint 
\[E. We observe that the transition from binary to ternary 
for C s mboth occurs at E = (1.66) 2 while it occurs for the 
capacity C with causal state information at the transmitter 
at E = (U(p on )\ Pon =o. 5 ) 2 = (1.74) 2 . We also observe that 
as E gets large, the capacity with an unlimited battery is 
significantly larger than the capacities with no battery, with 
or without the state information at the receiver. 

V. Conclusion 

In this paper, we considered the capacity of the AWGN 
channel with time-varying amplitude constraints. This scenario 
represents an energy harvesting communication system which 
uses harvested energy for data transmission and which has 
no battery to store the energy for future use. The energy 
arrivals impose amplitude constraints on the code symbol at 
each time. We found the capacity of this system. We showed 




Fig. 4. Capacity versus E when p O n=0.5. 

that the capacity achieving coding is performed by choosing 
code symbols from a finite set among the allowable continuum 
of points at each energy state. Next, we studied the on-off 
energy arrivals where the amplitude constraint is either zero or 
a non-zero value. We provided numerical illustrations for the 
capacity of the on-off energy arrivals. The numerical results 
indicate the capacity gain provided by an unlimited battery. 
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